Gaussianizing Transformations for ICA
نویسندگان
چکیده
Nonlinear principal components analysis is shown to generate some of the most common criteria for solving the linear independent components analysis problem. These include minimum kurtosis, maximum likelihood and the contrast score functions. In this paper, a topology that can separate the independent sources from a linear mixture by specifically utilizing a Gaussianizing nonlinearity is demonstrated. The link between the proposed topology and nonlinear principal components is established. Possible extensions to nonlinear mixtures and several implementation issues are also discussed.
منابع مشابه
Temporal Decorrelation as Preprocessing for Linear and Post-nonlinear ICA
We present a straightforward way to use temporal decorrelation as preprocessing in linear and post-nonlinear independent component analysis (ICA) with higher order statistics (HOS). Contrary to the separation methods using second order statistics (SOS), the proposed method can be applied when the sources have similar temporal structure. The main idea is that componentwise decorrelation increase...
متن کاملBlind Separation of Post-nonlinear Mixtures Using Gaussianizing Transformations and Temporal Decorrelation
At the previous workshop (ICA2001) we proposed the ACETD method that reduces the post-nonlinear blind source separation problem (PNL BSS) to a linear BSS problem [18]. The method utilizes the Alternating Conditional Expectation (ACE) algorithm to approximately invert the (post-)nonlinear functions. In this contribution, we propose an alternative procedure called Gaussianizing transformation, wh...
متن کاملDensity Modeling of Images using a Generalized Normalization Transformation
We introduce a parametric nonlinear transformation that is well-suited for Gaussianizing data from natural images. The data are linearly transformed, and each component is then normalized by a pooled activity measure, computed by exponentiating a weighted sum of rectified and exponentiated components and a constant. We optimize the parameters of the full transformation (linear transform, expone...
متن کاملBlind Separation of Post-nonlinear Mixtures using Linearizing Transformations and Temporal Decorrelation
We propose two methods that reduce the post-nonlinear blind source separation problem (PNLBSS) to a linear BSS problem. The first method is based on the concept of maximal correlation: we apply the alternating conditional expectation (ACE) algorithm—a powerful technique from nonparametric statistics—to approximately invert the componentwise nonlinear functions. The second method is a Gaussianiz...
متن کاملBilinear Sparse Coding for Invariant Vision
Recent algorithms for sparse coding and independent component analysis (ICA) have demonstrated how localized features can be learned from natural images. However, these approaches do not take image transformations into account. We describe an unsupervised algorithm for learning both localized features and their transformations directly from images using a sparse bilinear generative model. We sh...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2004